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General formulae and existence criteria are derived for the discrete power 
spectral densities of first-order Markov pulse trains, viz., infinite pulse 
trains in which each pulse corresponds to one member of a finite set of speci- 
fied waveforms and depends statistically on the previous pulse alone. These 
residts are obtained through a distribution theoretic decomposition of the 
spectral formulation given for such pulse trains by Huggins and Zadeh. 

I. INTRODUCTION 

An important problem related to first-order Markov pulse trains is 
that of calculating the discrete and continuous power spectral densities 
of such processes. The spectral formulation first given by Huggins 1 and 
later extended by Zadeh 2 is perhaps the most appropriate and straight- 
forward solution of this problem, the results being conveniently expressed 
in terms of the customary flow diagrams and recurrent event relations 
associated with Markov systems. As regards discrete spectra, however, 
their formulation lacks complete generality in two respects: (i) the limit 
notions of distribution theory, although essential for discrete components, 
are not incorporated; (n) discrete components do not appear explicitly. 
In this paper we reformulate the Huggins-Zadeh result on a distribution 
theoretic basis, and derive both explicit relations and existence criteria 
for the discrete spectral densities. It is intended also that the analysis 
illustrate the distribution theoretic techniques required in cases involv- 
ing more general spectral formulations. 

II. BACKGROUND 

The infinite pulse trains under discussion are treated as first-order 
Markov processes in that each pulse is assumed to correspond in wave- 
shape to one member of a finite set (alphabet) of real time functions 
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0,(0, and to depend statistically on the previous pulse alone. More 
precisely, we consider random processes of the form 

00 

X(t) = Jldn(t - In), IE (-00, CO) (1) 

n=— oo 

tn < tn+1 (2) 

where 

d n (t) eMOIf<eZi(-«o f •);• = 1,2, ••• ,M\ (3) 

P{d n = g, | dn-i = 9i ; d n -2 = git ; • • ■ I = P{d n = g>\ dn-i = g,\ (4a) 

P{(t n+ l - t n ) ^ T | d n = g t ; (in+l = Qi \ T ^ 0} ■ Cij(r) (4b) 

with t n signifying the nth occurrence time, and c„ the cumulative transi- 
tion distributions.* For fixed i and j, a, gives independently of n (i.e., 
the pulse position) the conditional probability of a direct transition from 
pulse gi to pulse g, within r seconds after the occurrence of the former. 
As in related studies, the statistical and combinatorial structure of (1) 
is represented by the usual flow diagram of Fig. 1 in which nodes, or 
"states," symbolize pulses gi, and directed links indicate possible 

transitions, t 

The flow diagram in conjunction with signal flow graph techniques 
yields directly the more complex probability functions of general inter- 
est. % Most important to the development here are the cumulative dis- 
tributions for first occurrences or recurrences, viz. 

P{(t n +m - tn) ^ t for some m ^ 1 | d n+m = Qj ; d n = gi ; 

dn+zi * gj{m = 1, • • • , m - 1); t ^ 0} = g, v (r). 

As indicated, qa denotes the conditional probability of a first occur- 
rence (recurrence if i = j) of state j within t seconds after an occurrence 
of state i. Although less basic than c<,- , functions q fi are entirely suffi- 
cient for the calculation of spectral densities; consequently, in this paper 
the set {qa} is regarded as initially specifying the Markov process in 

* As applied here, the terms "cumulative distribution" and "distribution" 
pertain to probability theory and distribution theory, respectively. 

t Zadeh 2 identifies the occurrence of state i with the generation of a unit impulse 
at node i, the impulse in turn functioning as the input to a linear filter with im- 
pulse response g { ; the corresponding responses due to all the nodes of the system 
are added directly to give the original pulse train. 

t The expositions by Huggins 1 and Aaron 3 illustrate in detail the various flow 
diagram methods by which transition and recurrent event probabilities of higher 
order are calculated. 
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Fig. 1 — Flow diagram. 

accordance with the following constraints: 

(i) To comply with the usual probability conventions, we assume g ti 
to be monotonically increasing, sectionally continuous, and such that 

£ q u {r) gl, re[0, oo) 

qij(r) = 0, re (-cc,0). 

Under these conditions both q {] and the probability densities /{/(r) = 
Ci/ir) exist as distributions, or generalized functions.* (Earlier in- 
vestigations have used /,•> exclusive of j*,.) 1,1 

(m) For pulses to occur with certainty and at distinct times (t n < 
t n+ i), it is required that 



(6) 



qu(r)-*\ ( 



) 



5.7(0) = qij(o + ) = o. 



(7) 
(8) 



Condition (7) merely asserts that every state is accessible from every 
other state, i.e., that the system is irreducible. 

Assuming the specification of pulse trains x(t) by either q ti or fa and 
denoting the spectral density of x(t) by S xx (f), we prove below that 

* Briefly, an ordinary function /(0 is an element of the space of distributions, or 
generalized functions, provided [1 + P]~ N f(l) e Li(- «,<») for some N ^ 0; more- 
over, for such functions as f(t) there exist distribution derivatives of all orders 
and generalized Fourier transforms. 4 ■*•• 
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SM) = am? {Z E ft(iH«.) [p. (r^g^ + * 



+ 






(9)' 



where 



Gi(s) = [ gi(r)e- 8T dr = £.g { 

Fij (s) = r e- ST d gij (r) = f B-"f ti (r) dr = £•/« 

J •'o 

= a + 27rt/, S = a - 2irif, i = V^l, / = frequency 
Vi = [I rdquir)] = lim [- _ ^ ( J = -^ 



a>0 



du = 



'V 



fi (t=i) 

o (* * j) 



and lim (D) { • } signifies a distribution limit (cf. Ref. 4, p. 107, and Ref. 
5, p. 183). The presence of Hm <D) and the conjugated variable s in rela- 
tion (9) is especially significant, both features constituting the essential 
modification of the spectral density expression given by Zadeh (cf. Ref. 
2, Eq. 9, and Ref. 1, Eq. 10b). These two formulations prove equivalent, 
however, relative to continuous spectra. Specifically, if / is such that 
Fu(2irif) 9± 1, then the distribution limit reduces to an ordinary limit, 
and S xx represents the same point value of the continuous spectral 
density as results from Zadeh 's expression. On the other hand, analyzing 
discrete spectra f requires a proper interpretation of functions 



1 - Fu(s) 



in the vicinity of points s = 2irif for which Fu(2irif) = 1; hence, the 
notion of distribution limits is in general necessary. Another item to be 
noted in (9) is the functional form of g, . Although it is assumed that 
gi e Li , one can relax this restriction in certain cases by first considering 
an infinite sequence of functions g t m e Li such that g t m — » g< e Li 
( m _> qo ) ( and then performing a second limit operation on the corre- 

* The quantity [F,,(l - Ffj)~ l + *.-,•] - Un(a) in (9) corresponds to the Laplace 
transform of what Huggins terms the "expectation density" [cf. Ref. 1, Eq. (10b), 

t The term "discrete" relates to both the discrete power spectrum and the line 
spectral density composed of Dirac delta functions. 
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sponding density functions S ZI <m) . An example illustrating this approach 
appears in Appendix A. 

The following development deals primarily with the distribution 
theoretic formulation of (9) and its decomposition into discrete and 
continuous components. A detailed proof of this formulation and an 
analysis of the two types of components are given in Sections III and IV, 
respectively. Discrete spectral density expressions for the basic classes 
of first-order Markov pulse trains are derived in Sections 4.3, 4.4, 4.5, 
and 4.6 (cf. Theorems II-VI). 

III. THE HUGGINS-ZADEH SPECTRAL DENSITY FORMULATION 

In deriving S„ , we find it convenient first to decompose x(t) into M 
separate pulse trains which consist individually of identical pulses; i.e., 
we set 



if 

E 



;(/) = !>/„(/ - U) = T,Xi(t) (10) 



where 



•r,(o - £</,«- O 



*„, (,> e [t„ | d„ = gt) 

i (,) <? i (i) 

t»n V. <m+l 

t m (i) < (m < 0) 

l m (i ' ^ (m ^ 0). 
Therefore, by standard spectral theory 7 S XI can be written as 

«-(/) - EIX*,-(/) do 



where 



T-»ao Zi 



*.r(0 = T,gi(t -t m (i) ) 



Ni = sup [m\t m h) e[-T,T]\ 
Mi = inf {?n\t m (i) e[-T, T]} 

JF- - f° dte- w " (i = V=l). 

J— oo 
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It is noted here that S X{Xj , the cross-spectral density of x t and x, , 
holds for both stationary and nonstationary processes. 
Combined with the relation 

5-XiT = Gi(2irif) Eexp (-2irift m li) ) (12) 

Mi 

(11) reduces to 

&*(/) = EZ^(-2^)(?i(2irt/)S w (/) (13) 

where 

Sij (f) = lim (U > ±E ittexp [-Mfiti* - L (0 )]}. (14) 

T &1 {Mi Mj } 

To transform the summation indices in (14), we let 

t n (i) - t m (i) = r m .* W) > (15) 

where integer k ^ 1 indicates the number of occurrences of state j in 
the interval (t m U) , t n U) ]; further, to eliminate the variation of summation 
indices across the ensemble, we define a weighting factor t] m , k * such 
that 

Hn fl; t m (i) and t n U) e[-T,T], C* < t W , ia , 
W " JO; tj» or ^rl-^n «- W <fc W . 

These definitions along with condition (8) relating to distinct occurrence 
times yield 

E^exp [-2^if(t n (j) - t m (i) )) = £ Z ^.* W/) exp (-2^V m ., ( ^) 

«-— (17) 

+ E £ 7, m ., 0, ' ) exp(27 rt yr m . t ' , ' 1 )+5^.T 



with JV,-t equal to the number of occurrences of state i in the interval 
\-T,T\. 

As random variables for the time difference between occurrences, 
T m .k ij) are characterized statistically by the cumulative distributions 
qij . In particular, (15) and (5) imply that 

P{r mil (ii) ^r\ = qij (r). (18) 

Moreover, since the quantity 

quit- r')y/ + Ar) -qn(r')} 
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gives the approximate probability of two specific occurrences of state 
j within t seconds after that of state i, it follows that the total probability 
of all such mutually exclusive events is expressed as 



f|t.ji ( * £ r| - f Q Qij (r - r')d qjj {r') s */»(*■). 



Generally 



P\r n . k m £ rj - fji/^ir - r') dq jj( r') S qt /»( r ) (A ^ 2) 



(19) 



(20) 



(i) 



Qij(r) = gii (r). 



At this point we introduce a basic device with which to simplify the 
summations in (17) as well as justify the interchange of various limit 
operations employed below. If functions q t j are specified so as to vanish 
not only for r ^ fcf. (6)] but also in an arbitrarily small neighborhood 
( — e, e), then there can be only a finite number of states in any finite 
time interval (i.e., P{-T ^ t m (i) ^ T\ = for all | m | sufficiently 
large), and the summations in (17) remain finite. Despite this initial 
restriction on q^ , the spectral density proves continuous in e; conse- 
quently, the resultant spectral formulation is viewed as having a final, 
nonexplicit limit corresponding to e — > 0. Such a limiting procedure is 
entirely sufficient for physical pulse trains. 

For evaluating the expectation in (14), we first define 

(21) 
(22) 




6(x) = l -^. (23) 

Hence, for any state i 

Hm (D) ^2: f~V,(0 

T 41 m J-T 

- Urn * ™2 [ [n(T - T - t) - M (-r - t)]dP m (t) 

T 41 m J-ao 

i ( r'- ) i (24) 

= Hm (D) ± B |S J_ T Bit' - O dt'j = lim i- E{N iT } 
= \Eil m li) - U* w )r l = [[ rdqui^V. 
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On the other hand, since 

1 - e~" 



1 —ST 

1 — e 



T («->0) 



^ r (Re s = a ^ 0) 



the dominated convergence theorem 8 yields 

8 



lim - 

**o 1 - Fu(8) 

a>0 



= Pi =\ lim 



!5 J! { ) —r-) d9 " (T) ] 



(25) 



= \im^ f ElN iT \. 



= / rdquir) 
Thus, again by the convergence theorem, there results 

I -2ri/T j (A-)/ \ 

Pi I e dqij {t) 

= lim (D) i [ M [S f "' dP.(«)l •■**" *V W (0 (26) 

T 21 J \_ m J -T J 



= lim 

T 



(T» 



rT^C[C iPM V"'^ M - 



Fundamental to the analysis of (26) is the following distribution the- 
oretic identity, a detailed proof of which appears in Appendix B: 



im< D) t f •** dg« W (r) - Hm ( + D) p^ • (27) 



lim 



From (26) and (27) it is found that 

= lim (D) t lim™ ^Z f [ f T " T dP m (t)] •** d Qij {k) (r) 

= Hm (D) 4 E £ ("I f T dP -W~\ e ~ 2 ' i/T ^ (W(t) (28) 

= lim (D) i= £ JZ E lb..™ exp ( -2 7rt /r m ., (i>) )} 



(D) 



FM 



= p,- lim - — , - — 
y a-.o+ 1 - Fn(s) 

Hence, (13), (14), (17), (25), and (28) combine to give 
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S„(f) = lim (D) EE<?.«) 



Fij(s) 



r vi - *w«) 



+ 



•«)^(^fe)]i- 



(29) 



IV. DISCRETE AM) CO.VTIXCOUS SPECTRA 



The evaluation of the distribution limit in relation (9), as shown be- 
low, centers mainly on analyzing the asymptotic behavior of functions 



FM 



i - FjM 



(Re s = a ^ 0; 



(30) 



as the variable s approaches singular points along the frequency axis, 
viz., points s = "lirifiov which Fjj{2irif) = 1 ; the results of this analysis 
together with certain general properties of F {j serve to resolve S xx into 
discrete and continuous components. 

Considering singularities of (30) first, one notes that 



v*oo 

Fjj(0) = / dqjjir) = limgyy(r) - qjj(0) = 1 

J T-00 

Fjj(s) I ^ f <r aT dqjj(T) = a ^ C- aT qjj(r)dT 

<a J e~ OT ch =1 (Re s > 0) 



Fjj(-2irif) = FjiVlwif). 



(31) 



(32) 



(33) 



Consequently, for all processes point s = is singular, points in the open 
half plane Re s > are nonsingular, and the existing singularities on the 
frequency axis occur in conjugate pail's. In establishing notation, we 
define 



Pi.n = 



sj.„ c {s | Fjj(s) =1; Res = 0T 
8j,„ = 'lirifj.n = §/._„ 
fj." < fj n+i 

fit = o 
J t exp (—Sj,„ r) dqa(r) \ 



(34) 



■r 



l 



*"(*/..) 



P/,11 = Pj.-<< 
Pj.o = Vi 



(35 



1 
1 - FM 
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Then, as in (25) 

f exp (-«i.«r)dg0<r) - ] q e~" dft/(r) J 

•exp (-s,-.„t) ^(t)? 
Pi.« (s -» s i" , Re s > 0) 



— s 



■},n 



On the basis of this asymptotic result it is found convenient to rearrange 
(30) as 

: Fij( j\ s = Q«(«) + ««(«) (37) 



where 



(38) 



(41) 



n..( s ) = ^2 £ Pi „ |"_J— + —1—1 

««<«) -*</(•) -Sft.«n <w (») (39) 

n 

^w = r^k- F « w ?7^ir. (40) 

The summations in (37) are considered for the moment to be finite and 
to involve only those singularities present in a frequency interval 

{-UJa). 

4.1 Functions Qa and Rn 

It is shown next that for / e ( -f A , J a) functions Q„ and R ti can be 
identified as contributing respectively to the discrete and continuous 

spectra: 

(i) That functions Q ti give rise to only discrete components follows 
immediately from the relation 
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Lim (W Gi(s)GMQM 

a-t)+ 

= MG,(-27rt/)^(27rz/)F (2nf)] 



■E Ps.n lim 



(D) 



2o 



ro> + 4,r»(/ - /,-,„)«] 
= i[(?<(?/Fi/l/Epi..lim (D) -ff-exp[-(a|<|) + 2«y y ,„<] (42) 

n a 

= l[6fliF t j)f E P;.n5-lim (D) -exp [-(a |< |) + 27rt/ J .„<] 

n a 

= i[dfiiFn]f Ez»/..7*eocp (2nfi.»<) 

n 

= M&G^l/E ?;.»«(/ -/;.»)• 

n 

{it) As regards functions #,■/ , we first determine the behavior of func- 
tions <S,j in the neighborhood of points s>,„ . Substituting definition (35) 
into (40) yields 

Vi.nFij { f [ J - exp[-(s - Or] ] 

" 1 - F* Vo L T s - •>.■ J 

•exp (—Sj,„t) dqjj(r) 

-> h*Ed**l r r 2 exp ( - Si .„r) <%,(r) 

(s — * s,-, n , Re s > 0) 

which implies that functions &,■ are both bounded and integrable in 
( —f A ,Ja), and that points s>,„ correspond to simple poles with residues 
Pj,»Fij(sj,„). Since functions «S, 7 - are integrable, they can contribute to 
only the continuous portion of the power spectrum. Regarding functions 
T„ (ll) next, we note that 



(43) 



(44) 
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)im {D> QfflGMTn {ii) (s) 

o-»0+ 

= hlGiGjFdflim^-S-Kvi-t) - M (0) 

a 

■ exp(-a|<| + 2irifj. n t)] 
= h&GiFuhS-Kni-t) - M (0) cxp &wifiM 

Hence, in a deleted neighborhood of s jt „ , functions 5P,, appear to pre- 
dominate all other terms of S xx . For showing that functions T n l,3) in 
fact sum so as to remain bounded, we set all pulses equal to zero except 
one, viz., gi . If under this condition S xx becomes unbounded as/ — »//,» , 
then (44) and (9) give 

&,(/) - vMGi IW* - ftAll/ [ aw(/~- /,,.) ]' (45) 

However, since the factor in braces is continuous at //.„ , the sign re- 
versal of the unbounded factor indicates that S xx assumes, contrary to 
definition, arbitrarily large negative values; therefore, 

Pj.nFjjCZwifi.r,) ~ pj.nFjA-Zlrifj.n) = 

which by (34) becomes 

Pi.n = Pj.n = Vi.-n (46) 

[The trivial case p>,„ = need not be considered inasmuch as the associ- 
ated terms in (37) -(41) vanish identically under this condition]. Condi- 
tion (46) is sufficient as well as necessary for the ratio 

FdMf)- Fd-*if) m [Fj/(s .j _ ,.,/(,,,„)] + „(/ _/,,) 
2mU — Ji.n) 

- [— - J-\ + 0(/ - /;.„) (47) 

LPi.n Pi.nJ 

= 0(/-/y.n) (/-/i.n) 

to be bounded in a neighborhood of point /,,„ . Similarly, allowing two 
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pulses to be nonzero and arbitrary yields 



(48) 



&.(/) ~ PiPjAGiGjFtj - GjGiFi,], 1" ... X 1 

|_2iri(/ - /;,,,) J 

+ Pi , pug/wh - m^-ih [ 2ir i(f~- fim) ] </ -> a- ) 

where the second term is present provided /,,„ = /,,,„ . It is evident that 
with the second term absent and both g. ; and g s arbitrary the first term 
cannot be made to vanish identically at/,,„ ; thus 

Sj.n = Si, m = Si,„ = s n (49) 

and 

\GiGj\piPj.nFii - PjPi.nFji] 

+ 6fii\PfPi,nF ii - p t V:.nFij]}/ n = 0. (50) 

Again because of arbitrary g { and g } there results 

P#j,nF ii {2lrif n ) = P.Vi.nFjii^irifn). (51) 

As in (47), this is a necessary and sufficient condition that (48) be 
bounded in a neighborhood of point/ = /,-,„ = /„ ; thus, for/ e ( -f A ,/,,) 
functions T n {,} \ S t j , and sums R ti contribute to only the continuous 
spectrum. It is important to note that although the use of R i} is neces- 
sary for an appropriate decomposition of S xx , the complete continuous 
spectrum can be obtained directly from relation (9) with / ^ /„ [cf. 
(9) et seq.]. Nevertheless, from a computational standpoint functions 
7?,7 might be more suitable. 

4.2 General Formulation for Discrete Spectra 

At this point we consider in detail both formulae and existence criteria 
for the discrete spectral density. With respect to the complete spectra) 
density, the substitution of definition (37) into (9) gives at once the 
decomposition 



&.(/) - lim™ E2ft(l)(?i(«)M«i(») + PjQdS)]' 

a-»0 + [ i j 

+ lim™ |Z Vi | G t (8) | 2 + ZZ [PiRij(s) + pjBjrfl)]} (52) 

where according to the properties of functions Q,-, and 72,-, [cf., (42), 
(51 ) et seq.] the first term in braces consists of discrete components only, 
and the second is bounded for/ e ( -f A , f A ). Consequently, on letting 
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Sj d \f) denote the discrete spectral density in the interval (— f A ,Ja), 
we obtain 

Sj d) (f) = lim (D) (ZZ GfflQMMM + pAM) (53) 
which by (42), (40), (49), and (51) becomes 

Sj d) (f) = § ZZ QflXpfv Z P/.»*(/ - /«) 

+ pAZm(/ + /.)1 

n J 

= § ZZ QflXvfu £ Pi.n*(/ - /-) 

+ p/i«EM(/ + /-)] (54) 

= ZZ GiGjFij Z P.P>.n5(/ - /.) 

i 3 " 

= zrzzp.p/.«G.(-27ri/) 

B L * J 

• Gy(2«/)F t -,(2irt/)j«(/-/«). 

Since the interval ( -/* , /a) is arbitrary, the sum over n in (54) can be 
extended as a distribution limit to include all the singular points along 
the frequency axis; hence, this expression represents the general formula 
for the discrete spectral density. In the sections immediately following, 
formula (54) is applied to the two fundamental classes of first-order 
Markov pulse trains: entirely random and stochastically uniform pulse 
trains. 

4.3 Discrete Spectra of Entirely Random Pulse Trains 

We define the processes under discussion to be entirely random if for 
at least one state i 

qu(-r) = qu(r) + Z «fc m) m( t ~" T * " ) 

k 

Mr) = qu'ir) = g„'(r) + 2W* " *«*) (55) 

k 

S a•* (, ' , ' , ^ 1 
g«(°°) + Z«* (,,> = * 
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where g« is either continuous and strictly increasing in some interval 
(t a , t b ), i.e. 

$,/(t) > tc(t a , t b ) (56) 

or q ix vanishes identically and the set of parameters T* (rt) consists of two 
or more incommensurate elements. Processes of this class are character- 
ized more completely by the following theorem: 
Theorem I: A pulse train is entirely random if and only if for any state i 

F«(2*if) *\ (/ * 0) 

(57) 
F«(0) - 1. 

For such processes all first recurrence distributions g,, have the same form. 
Proof: The second condition of (57) is merely a restatement of the gen- 
eral result given by (31). To establish the sufficiency of the first condi- 
tion, we consider the only possible form for q i{ not representable by (55), 
viz. 



ff«(r) = E«/''Vr - kTi) 

k-l 

UM = E«i cw «(r- kTi). 



(58) 



This yields 



whence 



F«(2irif) = £a* (W) e(-2,rtfA;!Z\) (59) 



'•HO 



F„[2*ifJ = l (n = 0, ±1, •••)• (60) 

Therefore, any g« satisfying (57) must be representable by (55) , and the 
process entirely random. To establish necessity, we consider (55) to be 
satisfied for at least one state i. Under condition (56) 



/*B I I f T B 

e -2r,/r ^..( r ) = / e~ 2 " fT qu di 

x -A II J *A 

< f qu'dr = J dqu(r) (f * 0) 

J *A J *A 

whence 

/*oo -QO 

|F«,(2«f)| < d qii (r) + Z** , " > = / dqu(r) = 1 (/ * 0). 
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On the other hand, with <?,, = and r* (W) incommensurate 

I Fii(2*if) | = I Z «* ( ' fl exp (-2rifr k m ) | < 1 (/ * 0). 

k 

Thus, (57) is necessary for state i. Finally, since Fa(2irift,n) = 1 and 
/.-,« = /„ for all i [cf., (31), (34), and (49)], the realization of (57) for 
any q« necessarily implies the same realization and consequently the 
same form for all g„- . 

Theorem I, although essential to the treatment of discrete spectra, is 
not the only test for identifying entirely random processes; a somewhat 
more direct test is afforded by the cumulative distributions c,y . In par- 
ticular, functions ga have form (55) provided at least one of the functions 
dj does also. This fact follows from a basic property of irreducible 
processes, viz., the property that each density /« = ft/(r) equals a 
specific combination of positive sums and convolutions of all the densities 

// \ 1,3 

c</(t). 

As regards singular points s n and discrete spectra, it is clear from The- 
orem I and (34) that the point s = s = constitutes the only singularity 
of entirely random processes; therefore, the formulation given by (54) 
becomes 

S xx (d) (f) = [ZEp^.oG ! < (0)G y (0)F,y(0)]8(/) (61) 

= [EEP.PA(0)G ; (0)]8(/). 

This expression leads immediately to the following result: 

Theorem II: The discrete spectral density of entirely random pulse trains is 

given by 

8j*(f) = {£ [E p*<«)] dtj 8(f) (62) 

which vanishes if and only if 

£ [2 Pi9i(t)~\ dt = 0. (63) 

Comparing (62) with (54), we note that Theorem II applies to the 
8(f), or dc, component of all the processes treated in this paper. 

4.4 Discrete Spectra of Stochastically Uniform Pidse Trains 

Processes not classified as entirely random are defined here to be 
stochastically uniform. It is evident that the only first recurrence dis- 
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tributions representing the uniform process, i.e., satisfying neither defini- 
tion (55) nor the criteria of Theorem I, must be of the form 

qu(r) = Z« k m n(r-kTi) 

rg «* (, ' l ' , ^ 1 (64) 

a k = 1 
Hi 

where parameters 2\ are assumed to have the largest values possible. 
Under this specification 

Fu(2iaf) = Z a» m exp (~2vifkTi) (65) 

<fc=l 

Hence, on letting i denote the state for which 

Ti ^ T, (i - 1, . . . , M) (GO) 

we find that all the singular values /„ satisfying 

F, Vo (2Wf n ) = 1 (67) 

are given by 

n 
A -^T (n = 0, ±1, ■■•)• (68) 

Furthermore, since 

F H (2Tif n ) = 1 (69) 

for all states fcf. (34) and (49)], then 

r^-ft-T (* = 1, - -• , AT) (70) 

which in turn implies that all Fa are periodic over an interval of length 
T~ , and all functions qu have the basic form 

00 

qu(r) = E«* ( "V(r - fcT 7 ). (71) 

Considering also relations (65), (68), and (35) it is seen that 



Pi.» = 



.? W J 



= P.-.o = p,-. (72) 



Finally, results (68), (70), and (72) combine with (54) to give the 
following theorem: 
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Theorem III: The discrete spectral density of stochastically uniform pulse 
trains is given by 

Sj d) (f) 

- rZE M>J0<< -2«y)G i (2irt/)F < ,(2«/)l Ea(/-n/T) (73) 

L i 3 J" °° 

T = n/fn 

Fu{2rifn) = 1 
which vanishes if and only if 

[EE fWto*Vf]-/r = (n = 0, ±1, • • • ) (74) 

or*/ 

[EE P.pA^F,;]/ = (- co < / < oe ). (75) 

At this point we consider a special but very important subclass of uni- 
form pulse trains, namely, that of uniformly positioned pulses. 

4.5. Discrete Spectra of Uniformly Positioned Pulse Trains 

Pulse trains are denned to be uniformly positioned over a reference 
interval of length T if the time intervals between successive pulses can 
assume only the discrete values kT (k = 1, 2, • • •), i-e., if function q {j 
take the form 



fl«(r) = E «*%(t - *T ) (i,j « 1, " • , M) 
fc— l 

^ a. (,i) ^ 1 (76) 

a* = 1 

k 

where To constitutes the maximum value for which this representation 
is valid. With qa so specified there results 

F«(2«/) = E «fc (W exp (-2irifkT ) (77) 

fc 

Consequently, for a particular state i the condition 
<w (l ° ^0 (/c' = 1,2, •••) 
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Oik = 



(k * Kk'] 



(78) 



holds for some maximum K ^ 1, the corresponding function Fa is 
periodic over an interval of length (KT )~\ and the singular values /„ 
satisfying (G9) arc given by 



/» = 



KT a 



(79) 



In addition, as values/,, are independent of i, condition (78) must for all 
states hold for the same value of K, the specific value in any particular 
case being determined either from one set of coefficients a* , from (79), 
or from the recurrence pattern associated with one node of the flow 
graph. For all K ^ 1, relations (77) and (79) yield the general condi- 
tions 



',(2^): I 



(K ^ 1; i,j - 1, ••• ,M; 



» = 0, ±1, •••). 



(80) 



Fii ( 2Ti Kf) = Fii(2irif " ) = 1 

*(*tSt)-M«A)) 

Combining these conditions with (79) and Theorem III, we obtain 

-[ls p* A^aI £ s 5 (/ - £ - A.) 

|_ » J J *=0 'i =-« \ JO -A- i 0/ 

= [e E m>A0j]/ 1 E m s (/ - j£) (si ) 

+ E /TS E P./>A( -2wif)Q£Mf) 

k-l [\_ i j 

The following theorem is based on this last expression: 
Theorem IV: The discrete spectral density of pulse trains uniformly posi- 
tioned over a reference interval of length T is given by 
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S xx (d) (f) = \T,PiG i (2*if) 2 ± «(/-£■) 

| j n=-« \ JO/ 

+ g {[E E mv0<( -Mm(Mf)r« (** j^r)] 



K = 



n 



Tofn 

F«(2ir#.) = 1 
which vanishes if 



(Xfcl; <,;- 1, ••• ,M; n-0, ±1, 



(82) 

(83) 

(84) 



E w(0 = o 

i 

E E M^« (2« ^r) £ W<r)fl<f + * - 

(fc = 1, ••• ,K- 1). 

A special case of Theorem IV is noted as follows: 
Theorem V: The discrete spectral density of uniformly positioned pulse 
trains corresponding to K = 1 is given by 



S xz {d) (f) = 



ZviG^if) 2 E *(/-£) 

i „= oo \ i 0/ 



Jn To 



which vanishes if 



E M(ti = o. 



(85) 



(86) 



Titsworth and Welch 9 have proved Theorem V for special pulse trains 
in which pulses are nonoverlapping and transitions occur every T 
seconds. This theorem is also implicit in the classic work of Bennett on 
synchronous pulse trains [cf. Ref. 10, Eq. (35), p. 1509]. 

4.6. Aaron's Discrete Spectral Formulation for Special Classes of Pulse 
Trains 

The analysis in Sections 4.3 and 4.5 yields the following theorem, a 
result first obtained by M. R. Aaron: 3 
Theorem VI: The discrete spectral density of entirely random pulse trains 
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and uniformly positioned pulse trains for which K = 1 [cf. (78) et seq.] is 
given by 

8j*(f) = Z [lies [Z QMUhwY «(/ - /„) (87)* 

where 

Ua = F Jt [l - Fa]' 1 + i„ (88) 

and Res [•] denotes (he residue of the quantity in brackets at s = s n = 

2irif n . 

Proof: From relations (36), (72) unci Theorem I we find that 

Res \ ® M l&) ~\ = p t Gi(2«if n )F ii (2icifn) (89) 

for either the entirely random or K = 1 case. On the other hand 

Fii(2rifn) = 1 (t, j = 1, • • • , M) (90) 

in both cases [cf., (79) and (80)]; thus, 

Res [ L GiV>A = E PiGi(2rif n ), (91) 

Inserting this expression into cither (61) or (85) gives formula (87). 

V. SUMMARY 

Theorems I through VI, which constitute the principal results of the 
preceding sections, give explicitly the discrete spectra of first-order 
Markov pulse trains. As presented, these theorems provide fundamental 
existence criteria for not only the analysis but also the synthesis of such 
processes. It is important to emphasize again that the distribution the- 
oretic techniques employed in extracting discrete components from the 
Huggius-Zadeh formulation are applicable also to more general spectral 
formulations. 
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APPENDIX A 

Entirely Random Square Waves 

For illustrating the techniques that often apply to cases in which 
0< e L\ , we consider a random square wave process of the form 

x(t) =al (-1) b-1 [m« " tn-i) - n(t - t n )} (92) 
x'(t) = y(t) = 2a E (-!)"*(< " O < 93 ) 

where y represents a two-state pulse train with pulses related by 

ffi = -(72 = 2a£(t) zU 

a = constant > 

and an entirely random statistical structure (cf. Section 4.3) specified 
by C12 , C21 , and 

Cll = c 22 = 0. (95) 

(Note that states 1 and 2 can be identified with the +0 and -a portions 
of the square wave x.) Thus, in accordance with definitions (4b) and (5) 

qvi = C12 , Q21 = C21 

(96) 



whence 

i^n = f 22 = F12F21 



/•OO 

1 = / C W (t - r')dc 2l (t) = g 22 
•'0 



h -J rdq u (r)= -^ = P2 = p. 



(97) 
Pi 



We next construct a set of "smooth" approximations to a:; i.e., we 
smooth out the corners and discontinuities of each of the pulse trains x 
into a sequence {x m (t)\ of continuous waveforms such that 

S„(f) = Hm (D) S ImX Jf) (m = 1, 2, • • ■ ) 

_ (98) 

x m '(t) -*.«) = Z(-l)V m) (i-'^ 

where 
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(m) T 

g e U 
lim <D) g {m) = 2a8(l) (99) 

m 

Am) (hi) (mj 

g = Q\ = -02 ■ 

Since pulse trains y„, and ?/ have the same transition properties and 
therefore the same statistical specification c<y , the former process is 
classified as entirely random; it then follows from the condition 

Zpi9i {m) = P(gx lm) + 92 m) ) =0 

i 

and from Theorem II [cf. (62)] relating to entirely random pulse trains 
that S VmVm has no discrete components. Consequently, relations (9), 
(97), (98), and (99) yield 

iffaUf) = Bm m [4irY^(/)] = lim ,D) S VmVm (f) 



= lim (D W2p|G' <m) (2W/) | 2 

m [ , (100) 

The most general function S xx satisfying this last expression is given by 

SM) - ^Rel" "/ 1 ^ 1 "^ l + KXt) = W</) (101) 

where the first term on the right represents a continuous component, and 
constants K\ and K 2 are to be determined. As spectral densities must be 
even functions, K» = 0. Regarding the discrete term, constant K\ is the 
square of the dc, or average, component of .r; hence, with 

a I t (Ic v >(t) — a I t dc n {r) 
ave [x(t)\ = — — 



/ r dq n (r) 

= apt] t diqAr) - 32i(t)]> 
= ap [F M '(0) - f»'(0)] 



(102) 
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(101) becomes 

q m 2pa 2 [ (1 -F 12 )(l -F n ) l 

SUf) - -^ Re L j _ Fi2Fzi j 7 (103) 

+ a 2 pW(0) - F 12 '(0)Mf). 

It is important to note here that the discrete component in (103) arises 
from the pulse structure of x and not from the singularities of [1 — Fa] . 
A more extensive treatment of this particular pulse train has been given 
by Aaron." 

APPENDIX B 

A Distribution Identity 

Essential to the formulation of the spectral density is the relationship 
between functions Fa and the limit of 

EWV) - Vjt(t) (104) 



as N — * «> [cf. (11) and (18)]. It is convenient to consider initially the 
integral 

f y N ( T )dr ^ z n (t). (105) 

Inasmuch as functions g*/ w and, consequently, y N are sectionally con- 
tinuous, then 

z N '(r) = y N (r) (106) 

almost everywhere in the classical sense or identically in the distribu- 
tion sense. Also, with gy/ w ^ [cf. (20)] function y N ^ 0, and 

^ z n (t) ^ z n (t + At) (At > 0) 

^ fer(r) ^ z N+l (r). (108) 

Considering the limit conditions on sequence {z N }, we note first from 
definition (20) and the properties of Stieltjes convolution 12 that 

f e-dz N {r) = £ r*~"*\ f Q^^dr] 

= t / -F ij (s)F Jj k - 1 (s) (109) 

k=l s 

= ±^\ 1 T ^f] (Re S = a>0). 

fc =i s LI - *M J 
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Therefore, the inverse Stieltjes transform 12 yields 

, v i r +ic ° i r I?* i „ , 

z n {t) = s — : / -d %- e as 

2m J a -too s- 1_1 — F#J 

2« *L,=o s 2 1_1 - F ti \ 
Finally, since (6), (8) and (9) imply 

I F<M | ^ / e~ aT ag,i(r) = « / e^q^r) dr 



257 



(110) 



< 



a / e~ aT dr = 1 (a > 0; i, * =- 1, • • •, M) 



(111) 



then 



Fij(8) 



5=2 i 3 T-^V- *" rfs ^ SU P 

| 2m J a -i>c s 2 \_l — Fjjj / 

■£^fe <M (a>0) 

\2mJa-ioo s 2 [_l - Fjjj /I 1 - F«(«) !■*-« « + 4ir 2 / 2 



1 - FjM 



Fjj(s) 

(a > 0) 



(112) 



(113) 



N ^ oo 



and, hence, the limit 

lim ^(r) - -L f "i rr-^%-1 e " ds s »(*) (« > o) ( 114 > 

AT-oo 2m J a -i°» s- |_1 — FyyJ 

exists. Relative to the asymptotic properties of function z we obtain 
from (25), (114), and (107) the conditions 

f c-dz{r) = 1 Fil i S ) ~% ( S ^0,a>0) (115) 
Jo si- Fj,(s) s 2 

(116) 



z{t) g z(t + At) (At > 0) 

which by Karamata's Tauberian Theorem 12 give 



*(t)~£t S (t -co). 



(117) 



This asymptotic result together with (112) and (114) implies that 



[1 + tT 2 z(t) eLK- oo,oo ). 



(118) 
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Thus, function z is a proper distribution, or generalized function (cf. 
footnote, Section II and Ref. 6, pp. 21-23). In addition, since 

=g z N ( T ) ^ z n+1 (t) g z(t) (119) 

then 

lim< D > z n (t) = z(t). (120) 

.V-»oo 

The functional properties of z as given by (112) and (117) imply also 
that 

lim< D > e~ aT z(r) = z(t) (a > 0). (121) 

O-.0+ 

In combining (104), (105), (106), and (120), there results 
<F- 2 "(r) = lim (D) -!F-V(r) = lim (D) -fF-y/ 



= lim (D) i; I" e- 2rifT d qi / k) (r). 

N k=l J 



(122) 



On the other hand, (114) and (121) give 
dr* 



ff.^(r) =5~-\im iD) [e- aT z(r)] 



^• iin r{(l +2 ^, +a2 ) [e " a ^ )] 

= lim (D) {[(2irif + 2a(27rt/) + a 2 ]S-[<T aT 2 (r)]} (123) 

a 

= lim™ {s^-le-^zir)]} 



= lim 



d Fij(s) 



1 - FM ' 
We finally obtain from (122) and (123) the following identity 

lim (D) E f <r 2 *' /T <W fc) (r) = lim (D) Fd^d \~ F i%Z f f ] 



Fij(s) 



(124) 



= lim 

«^o+ 1 - Fjj(s) 
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APPENDIX C 



Definitions of symbols 



x(t) 


— cf . equation ( 1 


Xi(t) 


-(10) 


djt) 


-(1) 


In 


— (1) 


tj" 


— (10) 


0i(0 


- (3) 


Gi(s) 


-(9) 


s,s 


-(9) 


*>j,n " Sn 


- (34), (49) 


a 


-(9) 


f 


-(9) 


Un = fn 


— (34), (49) 


Cij{T) 


-(4b) 


Qij(r) 


-(5) 


g./V) 


— (20) 


FiM 


-(9) 


8m(f) 


— (9), (11) 
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Sj*\f) 


-(53) 


Pi 


-(9) 


Pi.n 


-(35) 


JF 


-(H) 
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-(9) 


m(») 
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«(*) = /*'(■ 


r) — (23) 
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RM 
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Sij(s) 
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T n lil) (s) 


-(41) 


T 
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K 
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UiAs) 
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